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FOREWORD 


The  Army  Research  Institute  Field  Unit  at  Fort  Bliss  is  actively  engaged 
in  a  research  program  designed  to  Improve  the  evaluation  of  human  per¬ 
formance  in  air  defense  systems.  As  ta:tic?l  air  threats  have  increased, 
so  has  the  need  to  efficiently  coordinate  ground  defense.  With  the  ad¬ 
vent  of  computer-aided  command  and  control  systems,  the  identification 
of  human  strengths  and  limitations  has  become  critical  to  the  success  of 
the  Army  air  defense  mission. 

The  research  reported  in  this  paper  was  conducted  in  1975  during  the 
early  development  of  the  AN/TSQ-73  missile  minder.  The  missile  minder 
represents  a  class  of  emerging  air  defense  systems  which  place  unusual 
demands  on  the  processing  capabilities  of  the  human  operator.  The  pur¬ 
pose  of  the  research  was  to  evaluate  human  operator  performance  under 
realistic  task  loading,  aircraft  threats,  and  manning  configurations. 

As  a  result  of  this  study,  procedures  were  developed  which  can  effec¬ 
tively  be  applied  to  assess  operator  performance  under  a  wide  variety 
of  emerging  air  defense  systems.  The  procedure  can  also  be  utilized  to 
help  develop  firing  doctrine,  assist  human  factors  specification,  and 
improve  interoperability  decisions  in  linked  air  defense  systems.  This 
research  is  in  response  to  requirements  of  Army  project  2Q762722A765 
and  special  needs  of  the  U.S.  Army  Air  Defense  School  (USAADS),  Fort 
Bliss,  Tex. 
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Analysis  of  Manual  Threat  Evaluation  and  Weapons  Assignment  in  the 
AN/TSQ-73  Air  Defense  System 

BRIEF  _ 


Requirement: 

To  investigate  human  performance  under  varying  air  defense  threats. 

To  determine  human  overload  points  requiring  transition  from  manual  to 
automatic  operational  modes. 

Procedure: 

Air  defense  crews  were  evaluated  over  a  six-day  period  under  changing 
conditions  of  crew  configuration,  number  of  available  fire  units,  and 
attacking  aircraft  threat.  Switch  action  times  were  recorded  by  the 
AN/TSQ-73  computer  and  matched  against  event  times  in  predetermined 
threat  scenarios.  Analysis  of  operator  actions  utilized  switch 
actuation  latencies  and  operator  errors  (identified  via  incorrect 
switch  sequences).  Results  were  subjected  to  advanced  multiple  regress¬ 
ion  analysis  modeling  in  order  to  generate  predictive  formulas  for 
operator  performance  under  load. 

Findings: 

Hostile  aircraft  engagement  latency  averaged  3,47  minutes  for  system 
contact,  identification,  and  weapon  assignment  during  the  simulated 
combat  exercise.  The  chances  were  at  least  50  percent  that  the  air¬ 
craft  would  complete  its  run  if  it  was  in  a  major  assault  wave.  A 
manning  configuration  in  which  the  officer  implements  decisions  directly 
through  the  weapon  assignment  console  significantly  improves  assignment 
times.  Wave  size  of  aircraft  had  the  greatest  effect  on  the  weapon 
assignment  operator  although  the  aircraft  identification  operator  times 
increased  linearly  as  a  function  of  the  .number  of  aircraft.  Manual 
weapon  assignment  operators  tended  to  overload  at  eight  aircraft  and 
reaction  times  increased  rapidly.  Greater  numbers  of  fire  units  Improved 
weapon  assignment  times  but  only  if  eight  or  more  we^e  available. 

Operator  fatigue  may  be  a  significant  factor  in  weapon  assignment  under 
heavy  task  demands. 

Utilization: 

The  techniques  developed  in  this  report  can  be  applied  in  any  air  defense 
system  having  built  in  microprocessors  that  can  record  operator  switch 
actions,  such  as  the  developing  PATRIOT  system.  The  resulting  improved 
estimates  of  operator  actions  and  reaction  times  can  be  applied  to 
firing  doctrine  evaluation,  system  software  development,  the  man/machine 
i nterface,  -and  interoperability  studies  involved  in  linking  together 
command  and  control  systems. 
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I .  INTRODUCTION 


The  Army  is  fielding  a  new  air  defense  system  for  command  and 
control  of  Hawk  and  Hercules  Firs  Units.  Called  the  AN/TSQ-73  (Missile 
Minder),  the  system  contains  software  which  will  automatically  perform 
threat  evaluations  and  weapon  assignment  (TEWA).  The  chief  advantage 
of  the  automatic  TEWA  Is  its  speed  In  assigning  hostile  aircraft  to 
available  fire  units.  Given  sufficient  time,  it  Is  likely  that  the 
tactical  director,  by  virtue  of  being  able  to  take  into  account  complex 
information  and  recognize  event  patterns,  would  make  more  "intelligent" 

TEWA  than  the  machine  since  the  machine  TEWA  is  software  limited. 

The  tactical  director  performing  manual  TEWA  is  subject  to  increased 
information  loading  and  stress  as  the  number  of  aircraft  in  an  attacking 
wave  increases.  The  present  research  sought  to  investigate  human  TEWA  as 
a  function  of  wave  size  to  assist  in  the  determination  cf  a  manual  satura¬ 
tion  point.  Such  a  point  would  suggest  the  level  at  which  the  system 
should  transition  from  manual /semi -automatic  control  to  automatic  control 
as  the  intensity  of  a  battle  increases  and  the  number  of  radar  tasks 
become  too  numerous  for  manual  weapons  assignment.  While  some  argue  for 
exclusive  manual/semi-automatic  mode  operation  arid  others  for  an  all 
automatic  mode,  it  is  more  likely  that  the  system  will  reside  in  the  manual/ 
semi-automatic  mode  until  the  operators  and  tactical  directors  are  over¬ 
loaded  by  the  sheer  volume  of  tracks  requiring  attention.  At  this  point, 
the  operators  and  tactical  directors  would  transfer  the  system  to  the 
automatic  mode  but  still  maintain  constant  monitoring  and  override 
capabilities. 
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The  purpose  of  this  experiment  was  to  collect  baseline  data  from 
which  overload  points  could  be  determined.  It  was  judged  that  such 
points  would  be  a  function  of  the  number  of  hostile  aircraft  In  an 
attacking  wave  or  scenario,  the  number  o^  fire  units  under  direct  control 
of  the  Q-73,  and  the  rate  at  which  the  attacking  wave  approaches.  The 
first  two  variables  were  systematically  changed  In  the  experiment,  while 
the  third  was  fixed.  Also,  a  key  command  and  control  question  concerned 
whether  the  tactical  director  could  coordinate  activities  better  from  behind 
the  console  operators  or  at  the  weapons  assignment  console  where  he  could 
implement  his  fire  unit  assignment  decisions  directly  through  the  console. 
Thus,  the  third  primary  variable  in  the  experiment  was  the  manning 
configuration.  In  one  configuration  the  officer  was  behind  the  console 
operators,  while  in  the  second  configuration  the  tactical  director  sat  at 
the  weapons  assignment  console.  Also  included  for  control  purposes  were 
three  minor  variables.  They  were  the  specific  raid  scenario,  the  test 
day,  and  the  crew. 


II.  PROCEDURE 


Personnel  participating  In  the  experiment  (crews)  consisted  of 
three  Air  Defense  officers  and  six  enlisted  men  from  the  US  Army  Air 
Defense  School  (USAADS)  recently  detailed  to  Ft  MacArthur,  CA,  In 
connection  with  the  TACS/TADS  effort  In  1975.  (Pilot  data  were  collected 
from  an  "expert"  team  of  one  officer  and  two  enlisted  men  who  had  been 
assigned  to  the  TACS/TADS  project  for  over  a  year.)  While  the  crews  did 
not  receive  a  formal  training  program  on  the  AN/TSQ-73,  their  arrival  at 
the  testing  site  approximately  three  weeks  prior  to  the  start  of  the 
experiment  allowed  sufficient  time  for  them  to  become  familiar  with  the 
functions  and  operations  which  would  be  required  cf  them  In  the  experiment. 
Although  some  practice  effects  were  expected  to  be  found  over  the  six 
experimental  sessions,  all  crews  were  judged  to  be  qualified  for  operating 
in  the  Q-73  at  the  start  of  the  experiment. 

The  testing  environment  consisted  of  the  Interior  of  a  prototype 
Q-73  van.  The  principal  Items  of  equipment  were  two  operator  consoles. 
Identical  in  configuration,  which  were  placed  side  by  side  at  the  front 
of  the  van.  The  console  on  the  left  side  was  used  for  track  Identifica¬ 
tions  and  the  right  console  for  weapon  assignments.  Other  equipment 
Included  cenmunlcatlon  lines  for  cross  talk  between  the  simulated  Group 
73  and  Battalion  73,  and  between  the  Battalion  73  and  the  fire  units. 

An  officer  from  USAADS  served  as  Group  73  and  Issued  directives  to  the 
Battalion  73  as  required.  Four  experimenters  rotated  in  the  role  of 
simulating  "Squawk"  from  the  fire  units,  e.g.,  acknowledgment  of  assign¬ 
ment,  etc. 
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Data  collection  occurred  during  six  consecutive  evenings  between 
2200  and  0600  as  shown  at  the  bottom  of  Figure  1.  Data  was  collected 
for  the  expert  team  on  the  morning  of  the  seventh  day  between  0600  and 
0800.  Each  team  served  for  a  two-hour  period  each  evening.  Each  period 
consisted  of  two  one-hour  sessions.  (Simulation  equipment  constraints 
precluded  simulated  raid  tapes  from  being  over  one  hour  in  length.) 

USAAOS  prepared  scenarios  from  which  twc  raids  were  scripted  and  two 
raid  tapes  were  developed  for  use  in  the  Q-73's  simulation  mode  of  opera¬ 
tion.  To  assure  comparable  group  data,  all  video  viewed  by  operators  on 
their  radar  screens  was  generated  from  the  tapes  rather  than  from  live 
radar  signals.  The  simulation  package  also  included  the  capability  for 
periodic  recordings  of  the  status  of  all  actions  taken  by  the  operators 
and  the  times  of  these  actions.  In  addition,  the  system  periodically 
recorded  the  status  of  all  fire  units  under  control  of  the  Battalion  Q-73. 

During  each  one-hour  session,  a  team  would  be  exposed  to  three  different, 
assaults  or  waves  of  varying  size.  As  soon  as  an  aircraft  track  entered 
the  system  arid  three  simulated  radar  sweeps  verified  its  presence,  the 
track  became  available  to  the  ID  operator  seated  at  the  left  console.  All 
tracks  entered  with  an  unknown  identity.  Simulated  messages  into  the  Q-73 
resulted  in  change  of  status  symbols  replacing  unknown  symbols  on  the 
operator's  screen.  When  the  ID  operator  observed  this  special  symbol,  he 
"hooked"  the  track  by  placing  his  cursor  over  the  symbol  and  pressing  the 
appropriate  function  switches  to  reveal  whether  the  track  was  friendly  or 
hostile. 
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Figure  1.  Experimental  Design 


When  a  track  symbol  changed  to  hostile-  it  became  the  duty  of  the 
weapons  assignment  officer  to  select  a  fire  unit  to  engage  the  track. 

The  Q-73  system  has  limited  software  to  provide  automatic  assignment  of 
fire  units,  but  it  was  the  purpose  of  the  present  experiment  to  assess 
human  performance  capabilities  in  the  manual  weapon  assignment  mode. 

For  each  two-hour  session,  there  were  either  four,  six,  or  eight 
fire  units  under  control  of  the  Q-73  (see  Figure  1).  The  manning  config¬ 
uration  consisted  of  having  the  tactical  director  behind  the  console 
operators  or  seated  at  the  weapons  assignment  console.  Thus,  each 
combination  of  fire  unit  number  and  manning  configuration  resulted  in 
six  different  conditions  constituting  the  six  experimental  sessions. 
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III.  RESULTS  AND  DISCUSSIONS 

The  analyzed  data  consisted  of  383  sets  of  reaction  times  corres¬ 
ponding  to  complete  actions  taken  by  AN/TSQ-73  operators  on  hostile 
aircraft  during  days  1  through  6.  Thirty-three  additional  sets  of  times 
were  obtained  from  the  expert  group  and  were  used  in  non-parametric 
analysis  of  operator  training  and  familiarization.  Each  set  was  composed 
of  three  values  for  a  given  hostile  aircraft:  (1)  the  total  time  to  identify 
an  aircraft  and  assign  a  firing  unit;  (2)  the  proportion  of  the  time  required 
by  the  ID  operator;  and  (3)  the  proportion  of  the  time  required  by  the 
weapons  assignment  operator.  As  an  estimate  of  terminal  system  effective¬ 
ness,  percentages  of  successfully  engaged  aircraft  were  tabulated  for 
days  5  and  6.  A  breakdown  of  these  percentages  into  detailed  categories 
of  actions,  e.g.,  number  of  friendly  aircraft  Incorrectly  engaged,  was 
precluded  due  to  extraneou  factors  such  as  uncontrolled  Instructions  to 
the  operators,  system  problems,  and  errors  on  the  radar  track  tapes.  It 
was  still  possible,  however,  to  estimate  overall  performance  against 
hostile  aircraft.  These  percentages  are  reported  In  Table  1. 

This  Table  shows  the  percentage  effectiveness  of  the  operators.  It 
is  based  on  ratio  of  the  average  number  of  completed  identification/ 
weapon-assignment  sequences  to  the  average  number  of  completed  Identifica¬ 
tions  in  a  wave.  Effectiveness  remains  at  about  70%  for  low-  and  medium- 
size  waves.  It  drops  to  about  49£  for  high-wave  sizes.  In  this  experiment 
a  high-wave  size  was  25  or  more  aircraft.  It  is  possible  that  these 
estimates  may  be  conservatively  low.  Effectively  completed  sequences 
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may  have  been  restricted  by  uncontrolled  Instructions  Issued  during  the 
experiment  to  reduce  extraneous  noise  on  the  operators'  screens,  such  as 
bogus  track  Identifiers  created  by  rapidly  turning  aircraft. 

A  detailed  Investigation  of  operator  reaction  times  added  Insight  Into 
the  variables  Influencing  overall  effectiveness.  By  examining  operators' 
switch  actions  on  the  AN/TSQ-73  console,  it  was  possible  to  accurately 
determine  ID  and  weapon  assignment  times.  These  times  were  analyzed 
in  relation  to  the  experimental  variables  of  manning  configuration, 
number  of  fire  units,  number  of  aircraft  in  an  attacking  wave,  training 
group,  day  of  test,  and  raid-tape  scenarios.  To  maximally  explore  the 
relationships  present  in  the  data,  times  were  subjected  to  multiple  linear 
regression  analysis  using  an  IBM  360-65  computer.  The  data  were  tested 
against  90  different  models  corresponding  to  plausible  psychological 
outcomes.  Multiple  F-tests  were  then  used  to  choose  the  most  parsimonious 
models  with  the  greatest  degree  of  explained  variance J 

The  following  conclusions  were  supported  by  reaction  time  data.  The 
average  total  time  to  identify  and  successfully  engage  a  hostile  aircraft 
was  208  seconds.  (Start  time  was  estimated  at  about  24  seconds  after  the 
system  first  contacted  the  radar  track.)  The  average  time  to  correctly 

^It  should  be  noted  that  the  degrees  of  freedom  used  in  these  F 
statistics  represent  model  comparisons  and  are  not  always  directly  related 
to  the  number  of  experimental  variables  as  is  the  case  in  the  usual  ANOVA 
Table.  The  reader  is  referred  to  the  appendix  for  reference  detailing 
this  procedure. 


9 


Identify  a  friendly  aircraft  was  57  seconds.  The  ID  and  weapons  assign¬ 
ment  (WA)  operators  did  not  always  respond  In  the  same  manner  to  the 
experimental  variables.  Manning  configuration  had  a  significant  effect  on 
UA  reaction  times  (F^  3i8)“9*49  P<.01 ) .  When  the  officer  implemented 
decisions  through  the  console  his  mean  reaction  time  was  91.6  seconds 
versus  131.4  seconds  when  he  served  as  tactical  director.  This  was  an 
average  Improvement  of  39.8  seconds,  or  about  30%. 

Number  of  fire  units  also  effected  WA  time  ( Fg  380)"4.14  P<* 05) . 

Reaction  times  were  approximately  equal  for  four  or  six  fire  units 
( )(4= 116  seconds  versus  Xg=114  seconds).  Eight  fire  units  reduced  the 
average  WA  times  to  )Tg*69  seconds.  Caution  should  be  used  In  Interpreting 

this  result  however.  The  percentage  of  explained  variation  due  to  fire 
2  2 

units  was  low  (M  =.0213  where  H  is  squared  multiple  correlation 
coefficient  of  the  fire  unit  variable)  which  mean*;  that  although  the 
effect  was  statistically  significant,  number  of  fire  units  contributed 
little  to  overall  prediction  of  reaction  time.  Increased  numbers  of 
fire  units  may  improve  overall  effectiveness  as  well,  but  due  to  a  lack  of 
usable  performance  data,  this  question  could  not  be  answered. 

The  most  powerful  predictive  variable  was  wave  size.  The  most 
efficient  predictive  model  was  a  linear  function  of  ID  (F^  381j=7.22  P<.001) 
and  a  cubic  function  of  WA  (F2  38o)38,06  P<. 001 ) .  Least  squares  fitting 
of  alternate  models  show  ID  is  best  fit  by  the  linear  function: 

RTid=60.3  +  2.05W 

where  W  is  the  numberof  aircraft  In  the  attacking  wave.  Actual  mean 


values  for  ID  times  are  plotted  In  Figure  2  as  a  function  of  wave  size. 

For  WA  the  linear  trend  seen  In  ID  times  was  not  evident.  Figure  3  shows 

mean  reaction  times  already  rising  rapidly  at  eight  aircraft,  suggesting 

that  the  WA  operator  was  already  overloaded.  Latencies  reach  a  peak 

of  176  seconds  per  aircraft  at  16  aircraft  and  recede  to  a  steady  state 

level  of  100  seconds  thereafter.  Though  dropping  from  the  highest  value, 

terminal  WA  times  are  still  well  over  a  minute  longer  per  aircraft  than 

at  a  wave  size  of  eight.  This  decrease  coincides  with  a  loss  In  overall 

effectiveness  and  may  be  due  to  the  forced  adoption  of  faster  but  less 

optimal  WA  strategies  for  assigning  hostile  targets  to  the  most  appropriate 

fire  units.  Comparisons  between  possible  wave  models  showed  the  WA  data 

was  best  fit  by  a  cubic  equation: 

RTWA«13.23w-.012w3-29.37 

The  cubic  fit  was  a  significantly  better  predictor  than  either  a  linear 
or  a  second  order  equation  (F^  380j=4.29P<.05). 

An  overall  best  equation  for  estimating  total  reaction  time  Is  the 
sum  of  the  optimal  ID  and  WA  equations: 

RTtqt=30 .93+15. 28w- . 01 2w3. 

The  mean  RTs  for  the  total  data  are  shown  In  Figure  4  along  with  the 
predictive  curve  generated  by  the  above  formula. 

Analysis  of  the  variables  of  days  and  raid  tapes  generated  new 
research  questions.  Times  from  two  raid  tapes  showed  no  difference  for 
ID  (Fp  ^Qi ^=2 .18  P> . 20)  but  a  significant  difference  for 
WA  (Fp  3glj=9.05  PC005).  This  could  imply  that  the  WA  task  Is 
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more  sensitive  to  the  attack  configuration  than  the  ID  task*  since 
the  raid  tapes  generated  different  numbers  of  artificial  tracks  on  the 
radar  screens  depending  on  the  aircraft  maneuvers  utilized  In  the  raid. 

Reaction  time  data  show  a  significant  effect  over  days  on  ID  and  WA 
times  ( Fj q( 5 , 377)=2 . 59  P<.25,  FWA(5,377)=5.64  P<.001).  Times  over 
days  were  best  fit  by  simple  linear  functions  which  are  plotted  in  Figures 
5  and  6. 

RTI0=149. 66-13. 14d 

RTWA=32.97+19.87d 

where  d  is  the  day's  number  d  e  {1,  2,  3,  4,  5,  6}.  The  most  Interesting 
fact  about  these  data  Is  that  ID  and  MA  functions  had  opposite  slopes. 

The  negative  slope  of  the  ID  function  means  RT  decreased  over  days  for  the 
ID  operator.  The  positive  slope  for  WA  showed  just  the  opposite  effect. 

The  interpretation  of  this  finding  Is  difficult.  One  possible  explanation 
could  be  that  the  WA  task  Is  more  fatiguing  to  the  operator  and  Increased 
latency  due  to  fatigue  obscured  normal  improvement,  resulting  from  practice 
effects.  If  this  is  the  case,  it  implies  that  WA  operator  fatigue  during 
combat  could  markedly  increase  response  times.  To  more  fully  Investigate 
repetition  effects,  an  additional  analysis  was  conducted  using  the  33  time 
sets  from  the  expert  group.  Since  the  expert  group  participated  only 
during  one  special  session  of  the  experiment  but  were  still  highly  trained, 
it  was  felt  that  their  performance  could  reflect  ID  and  WA  training  effects 
without  experiment  fatigue.  Expert  times  were  paired  with  mean  times  from 
the  experimental  groups  on  days  5  and  6  on  the  basis  of  aircraft  simulation 
numbers  coded  into  the  raid  tapes. 
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Due  to  the  low  number  of  expert  scores  and  the  possible  violation 
of  normality  assumptions,  a  non-parametrlc  Wllcoxen  matched  pairs  signed- 
ranks  test  was  chosen.  The  results  showed  no  significant  difference  for 
ID  times  (Z=1.03  p<.15),  but  faster  weapons  assignment  times  for  the 
expert  group  (Z=3.39,  pc.01).  Mean  WA  time  for  experts  was  62.6  versus 
82.0  seconds  for  days  5  and  6.  This  difference  could  still  represent  only 
greater  familiarity  with  the  Q-73  operating  system.  Such  a  possibility 
receives  support  from  the  experts  greater  use  of  system  switch  options 
as  well  as  superior  ability  to  handle  extraneous  verbal  "squawk"  evidenced 
on  tape  recordings  made  of  the  sessions.  However,  it  could  also  be  a  result 
of  fatigue  differences.  Additional  research  could  provide  the  answer  by 
testing  the  issue  directly. 


IV.  CONCLUSIONS 


Tentative  conclusions  may  be  drawn  for  some  of  the  original  research 
questions.  First,  TEWA  In  the  semi-automatic  mode  Is  not  Instantaneous. 
Average  time  for  system  contact,  identification,  and  weapons  assignment  in 
the  AN/TSQ-73  system  was  3.47  minutes.  Second,  manning  configuration  in 
which  the  officer  Implements  decisions  directly  through  the  WA  console 
significantly  Improves  assignment  times.  Third,  wave  size  has  its  greatest 
effect  on  the  WA  operator,  although  ID  times  do  Increase  linearly  as  the 
number  of  aircraft  Increase.  Fourth,  WA  Is  overloading  at  eight  aircraft 
and  reaction  times  Increase  rapidly.  Increased  numbers  of  fire  units  do 
improve  WA  times  but  only  If  eight  or  more  are  available.  Finally,  oper¬ 
ator  fatigue  could  be  a  consideration  In  WA  under  heavy  task  demands. 
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APPENDIX 


The  techniques  used  in  this  report  to  determine  predictive  formulas 
involved  a  multiple  linear  regression  program  modified  by  Jorgensen  to 
permit  rapid  generation  of  model  vectors.  A  discussion  of  the  statistical 
logic,  model  construction,  and  general  programming  methods  is  available 
in  "An  Introduction  to  Linear  Models"  (Ward  &  Jennings,  1973). 

Briefly  the  technique  involves  solving  for  parameters  in  a  theoretical 
equation  previously  defined  by  the  experimenter  to  reflect  specific 
psychological  ‘assumptions.  This  is  done  through  a  least  squares  fit  of 
the  equation  parameters  to  raw  or  transformed  data.  The  program  then 
generates  the  standard  beta  weights  and  regression  constant  for  that  solution. 

p 

The  predictive  power  of  the  equation  is  specified  by  M  ,  the  squared  multiple 

2 

correlation  coefficient.  M  is  mathematically  equivalent  to  the  percent 
of  explained  variation.  Through  the  use  of  alternate  equations,  F  ratios 
can  be  set  up  to  compare  various  assumptions  in  terms  of  their  explained 
variation.  Analysis  of  variance  and  factorial  analysis  of  covariance  are 
two  of  the  many  possible  model  formulations  which  could  be  utilized  within 
the  regression  framework. 

Usually  the  most  efficient  strategy  for  finding  optimal  moaels 

consists  of  postulating  a  general  all-encompassing  equation  which  takes 

into  account  a  linearly  independent  set  of  predictor  variables  based  on 

2 

conditions  used  in  the  experiment.  The  M  for  this  model  serves  as  a 
maximum  against  which  the  predictive  power  of  other  simpler  models  is 
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judged.  The  simplest  possible  predictive  model  is  the  mean  of  the 

distributions.  An  F  ratio  formed  between  the  general  model  and  the 

mean  model  tests  the  usual  null  hypothesis  for  equality  of  means.  By 

using  the  same  technique  with  more  complex  models,  F  tests  can  be  set  up 

comparing  various  models  to  the  general  model  and  to  each  other.  This 

is  analogous  to  analysis  of  covariance.  The  pattern  of  significant  F 

2 

ratios  as  well  as  the  M  efficiency  of  the  models  quickly  points  out  the 
most  efficient  and  parsimonious  aquations  for  a  given  set  of  assumptions 
and  predictive  power. 

For  example,  in  this  experiment  the  three  general  models  were  all 
predictive  equations  taking  into  account  raid  tapes,  low,  medium,  or 
high  wave  sizes,  days,  manning  configuration,  groups  and  fire  units. 

A  different  general  equation  was  generated  for  total,  ID,  and  weapons 
assignment  times.  In  this  analysis  four  types  of  models  were  considered: 
orthogonal  component  models  for  each  variable  of  interest  (these  are 
equivalent  to  a  one-way  analysis  of  variances  for  each  variable),  linear 
models  (equivalent  to  simple  linear  regression  fits),  second  and  third 
order  polynomial  models  (which  investigated  parabolic  curves)  and  mixed 
models,  such  as  a  linear  model  going  second  order  at  a  specific  point. 

The  following  are  examples  of  a  general  12-element  orthogonal  model  for 
total  times,  a  model  based  on  six  wave  sizes,  a  linear  model,  and  a 
polynomial  model: 


22 


Time  (total)  -  aoXra:S2+a2X3*“allXir 
Time  (total)  "  aoVa1Y2+a2Y3Y4+a4Y5+a5Y6 
Time  (total)  U+aW 
1<me  (total)*  u+aW,-a]w2+a2W 

where  X-j...X^  are  column  vectors  of  0‘s  and  l's  partitioning  total  data 
times  Into  orthogonal  sets  as  a  function  of  such  variables  as  days,  1  ives 
or  raid  tapes. 

Yj...Yg  are  column  vectors  of  0's  or  l's  partitioning  total  times 

into  sets  for  wave  size  one  through  6,  respectively. 

U  Is  a  unit  vector  of  l's.  W  is  a  column  vector  containing  the 

numbers  one  through  6  corresponding  to  the  size  of  the  wave. 

2 

U  Is  the  direct  product  of  W  with  itself, 
a  is  a  beta  weight  for  the  regression. 

Though  many  models  were  considered  and  fit,  only  the  most  parsimonious 
and  experimental  meaningful  are  reported  In  this  paper.  The  equations 
derived  represent  best  fits  for  the  available  data.  Their  general izabllity 
assumes  the  general izabllity  of  the  experimental  situation  to  the  combat 
usage  of  the  AN/TSQ-73. 
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